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Abstract 

The model of a domain wall (" thick" brane) in noncompact five-dimensional space- 
i-S^ ■ time is considered with geometries of AdS^ type generated by self-interacting scalar 

matter . The scalar matter is composed of two fields with 0(2) symmetric self inter- 
action. One of them is mixed with gravity scalar modes and plays role of the brane 
formation mode (due to a kink background) and another one is of a Higgs-field type. 
The interplay between soft breaking of 0(2) symmetry and gravity influence is thor- 
oughly investigated around the critical point of spontaneous r symmetry breaking when 
the v.e.v. of the Higgs-type scalar field occurs. The possibility of (quasi) localization 
of scalar modes on such thick branes is examined. 

1 Introduction 

Recent years, the models based on the hypothesis that our universe is a four- dimensional 
space-time hypersurface (3-brane) embedded in a fundamental mult i- dimensional space [1],[2] 
have become quite popular, see, for example, the reviews [3]- [11] and the references therein. 
The number of extra dimensions, their characteristic size and the number of physical fields, 
which are spread out the bulk space, may be different in various approaches. At the same 
time it is assumed that the additional space size is large enough, and additional dimensions 
can be, in principle, detected in terrestrial experiments planned in the near future and/or 
in astrophysical observations. Four dimensions of our world can be ensured, in particular, 
by the localization mechanism of matter fields on three-dimensional hypersurfaces in multi- 
dimensional space, i.e. 3-branes. Different scenarios of domain walls description and their 
applications to elementary particle physics and cosmology can be found in a number of re- 
views |1] - [11]. The influence of gravity is especially interesting, which plays an important 
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role in a (quasi)localization of matter fields on the brane [12] - [23]. The question arises, 
under what circumstances the (quasi)localization of matter fields with spin zero on a brane 
is still possible when the minimal interaction with gravity is present? This work is devoted 
partially to answer this question. 

In this paper we consider a model of the domain wall formation with finite thickness 
("thick" branes ) by self- interacting scalar fields and gravity in five- dimensional noncompact 
space-time [21] with anti-de Sitter geometries on both sides of the brane. The formation of 
"thick" brane with the localization of light particles on it was obtained earlier in [25] with the 
help of a background scalar and the gravitational fields, when their vacuum configurations 
have nontrivial topology. Appearance of scalar states with (almost) zero mass on a brane 
has happened to be possible. However, as it was previously shown [22], the existence of 
the centrifugal potential in the second variation of scalar-field action may lead to absence of 
localized modes on a brane. 

In the present work the scalar matter is composed of two fields with 0(2) symmetric 
self interaction. One of them ("branon" [26]) is mixed with gravity scalar modes and plays 
role of the brane formation mode (due to a kink background) and another one is a fermion 
mass generating (FMG) field (replacing a Higgs field). The soft breaking of 0(2) symmetry 
by tachyon mass terms for both fields is introduced which eventually generates spontaneous 
breaking of translational symmetry due to formation of kink-type field v.e.v. Furthermore for 
special values of tachyon mass terms the critical point of spontaneous r symmetry breaking 
exists when the v.e.v. of the FMG scalar field occurs. In the first phase the only nontrivial 
v.e.v. is given by a kink configuration. But the branon fluctuations around kink in the 
presence of gravity are suppressed by the universal repulsive centrifugal potential which 
survives in the zero gravity limit [22]. Thus gravity induces a discontinuity in the branon 
field spectrum. However the FMG field in this phase decouples from branons, is massive 
and exhibits a more regular weak gravity behavior. In the second phase the Higgs-type field 
obtains a localized v.e.v. to be used for generation of fermion masses [25]. Both fields, 
branons and FMG scalars, are mixed and the scalar mass spectrum and eigenstates must be 
found by functional matrix diagonalization. 

The work starts (Section 2) with brief motivation of necessity for two scalar fields to 
provide fermion localization on domain wall [27] -[36] and to supply localized Dirac fermions 
with masses. In Section 3 the model of two scalar fields with their minimal coupling to 
gravity is formulated for arbitrary potential and the equations of motion are derived. In 
the subsection 3.2 the scalar potential is restricted with a quartic 0(2) symmetric potential 
and soft breaking of 0(2) symmetry quadratic in fields ( as it could arise from the fermion 
induced effective action [23]). For this Lagrangian the gaussian normal coordinates are 
introduced and the appropriate equations of motion are obtained. The existence of two 
phases which differ in presence or absence of v.e.v. for the FMG field is revealed and the 
solutions for classical background of both scalar fields are found in the leading approximation 
of the gravity coupling expansion. In the Subsection 3.3 the next-to-leading approximation 
is performed. 

In the section 4 the full action is derived up to quadratic order in fluctuations in a 
vicinity of a background metric. It is dedicated to the separation of equations in respect 
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to different degrees of freedom. At tlie end of this section the action of scalar fields for the 
brane and gravity is obtained in gauge invariant variables. In sect. 5 the mass spectrum for 
the "thick" brane in the theory with a quartic 0(2) symmetric potential and soft breaking 
of 0(2) symmetry quadratic in fields is investigated around the critical point in the weak 
gravity expansion. In conclusion, we discuss results and prospects of the proposed model. 

2 Motivation of the two scalar field model 

Let start with elucidating how to trap fermion matter on a domain wall - "thick brane". 
The latter one emerges in the model of five- dimensional fermion bi-spinors ip{X) coupled to 
a scalar field $(X). The extra-dimension coordinate is assumed to be space- like, 

(X„) = (X^,Z), (X^) = (Xo,Xi,X2,X3) , (r?aa) = ( + ,-,-,-, -) 

and the subspace of corresponds to the four-dimensional Minkowski space. The extra- 
dimension size is assumed to be infinite (or large enough). The fermion wave function then 
obeys by the Dirac equation 

[27a5"-<l>(X)]^(X) = 0, 7a = (7m, -^75) , {la,lp} = 2Vaf5 , (1) 

with 7q, being a set of four-dimensional Dirac matrices in the chiral representation. 

The trapping of light fermion states on a four-dimensional hyper-plane - the domain 
wall - the "thick brane" is provided by localization mechanism in the fifth dimension at 
z = zq. It is facilitated by a certain z-dependent background configuration of the scalar 
field (<I>(X))o = <^{z), which provides the appearance of zero-modes in the four- dimensional 
fermion spectrum. For the four-dimensional space-time interpretation, Eq. ([1]) can be de- 
composed into the infinite set of fermions with different masses calculable from the following 
squared Dirac equation, 

[27a5" + viz) ][tj^d" - ^(z) ]i;{X) ^ i-d.d'^ - ml)i;iX) ; 

ml = -dl + v\z) - 75<^'(^) = mlPL + mlPn , (2) 

where Pl,r = 75) are projectors on the left- and right-handed states. Thus the mass 

squared operator ml consists of two chiral partners 

ml = -dl + v\z)Tv'{z) = [-d.±^{z)][d.±^{z)]; (3) 
g"*" = m^, g~ = g~ , = + Lp{z) . (4) 

Due to such a supersjTiimetry [37]- [39], for non- vanishing masses, the left- and right-handed 
spinors in (jl]) form the bi-spinor describing a dim-4 massive Dirac particle which is, in 
general, not localized at any point of the extra-dimension for asymptotically constant field 
configurations (p{z). Such a spectral equivalence may be broken by a normalizable zero mode 
of one of the mass operators m^. This mode is read out of Eqs. ([3]) and (jl]) 

q~i:^{x,z) =0 , ij^{x,z) = tpiix) exp S^- dw(f{w)^ , (5) 
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where ipiix) = Pi'ipix) is a free-particle Weyl spinor in the four-dimensional Minkowski 
space. Evidently, if a scalar field configuration has the appropriate asymptotic behavior, 

if{z) ±C±|zr± , Rez/± > -1 , C±>0 , 

then the wave function iIjq{x,z) is normalizable on the z axis and the corresponding left- 
handed fermion is a massless Weyl particle localized in the vicinity of a four-dimensional 
domain wall. If ip{z) is asymptotically constant, with C± > and z/± = then there is a 
gap for the massive Dirac states. 

In this paper we restrict ourselves with generating parity symmetric branes by field 
configurations of definite parity. The example of a parity odd topological configuration is 
realized by a kink-like scalar field background (of possibly dynamical origin, see below) 

= Mtanh(Mz) . (6) 

The two mass operators have the following potentials 

ml = -dl + M^[l- 2sech2(M2) ] ; m^^ = -dl + M^, (7) 
and the left-handed normalized zero- mode is localized around 2; = 0, 

V^o+(x, z) = ^i(x) V^o(^) , Mz) = ^Mj2 sech(Mz) . (8) 

Evidently the threshold for the continuum is at and the heavy Dirac particles may have 
any masses m > M. The corresponding wave functions are spread out in the fifth dimension. 

But the fermions of the Standard Model are mainly massive and composed of both left- 
and right-handed spinors. Therefore, for light fermions on a brane one needs at least two 
five-dimensional fermions il'i{^),4'2{X) in order to generate left- and right-handed parts of 
a four- dimensional Dirac bi-spinor as zero modes. The required zero modes with different 
chiralities for ($(X))o = <f^{z) arise when the two fermions couple to the scalar field 
with opposite charges,, 

[z^-r3$(X)]^(X) = 0, ^ = 7a5", ^{X) = 

where 'ja = I2 are Dirac matrices and = I4 (8> CTa, a = 1, 2, 3 are the generalizations 
of the Pauli matrices 0"^ acting on the bi-spinor components ipii^)- 

In this way one obtains a massless Dirac particle on the brane and the next task is to 
supply it with a light mass. As the mass operator mixes left- and right-handed components 
of the four- dimensional fermion it is embedded in the Dirac operator ([9]) with the mixing 
matrix Timj of the fields ipiiX) and iIj2{X). If realizing the Standard Model mechanism 
of fermion mass generation by means of dedicated scalars, one has to introduce the second 
scalar field H{x), replacing the bare mass Tirrif — y tiH{x) in the Lagrangian density [25], 

=^{i^-Ts^-TiH)^. (10) 



^i(^) 



(9) 
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Both scalar fields may be dynamical and their self-interaction should justify the spontaneous 
symmetry breaking by certain classical configurations trapping light massive fermions on 
the domain wall. If the lagrangian of scalar fields is symmetric under reflections $, — $ and 
H — y — H then the invariance may hold under discrete r-symmetry transformations, 

$ — (11) 
— y-<^,-H] (12) 
H — >-H, (13) 

the T2 symmetry in fact can be extended to the continuous t/r(l) symmetry under rotations, 

— exp{iar2/2}\I^; $ — )■ cosa<l> + sinaif, H — ^ - sin a$ + cos aif, (14) 

which could be a high-energy symmetry if the scalar field lagrangian adopts it for large values 
of fields. But at full these symmetries do not allow the fermions to acquire a mass unless 
translational invariance is spontaneously broken in the scalar sector. 

There may be several patterns of the partial r symmetry breaking by scalar field back- 
grounds. The first one is generated by a z-inhomogeneous v.e.v. of only one of the fields, 
say, the field ^{z) with H{z) = . Then the Ts symmetry certainly survives but the ri^2 
symmetries are broken. Still if the function ^{z) is odd against reflection in z the latter sym- 
metries can be restored being supplemented by reflection z — > —z (r3P(arity) symmetries). 
The second pattern is supported by 2;-inhomogeneous v.e.v. 's of both scalar fields provided 
that $(-2) 7^ H{z). Then, in general, none of the r symmetries holds. But if ^{z) and H{z) 
are odd and even functions respectively, the t^P symmetry may again survive. 

Thus one may anticipate a phase transition between the phases with different symmetry 
patterns which is presumably of the second order if the v.e.v. H{z) is continuous in coupling 
constants of the model. This realization is welcome to implement light fermion masses near 
a phase transition which are governed by a small deviation in parameters of the scalar field 
potential around a scaling point much less than the localization scale M. 

Further on we assume that the dynamics of fermions and scalar fields is r- and Ur{l)- 
symmetric ( fT3l) . ( |T^ at high energies whereas at low energies f/T-(l)-symmetry is broken 
softly and r-symmetry is violated spontaneously. Accordingly the scalar field potential 
contains even powers of fields ^{z) and H{z) and its profile induces the required spontaneous 
symmetry breaking. A concrete model for two phases with broken translational invariance 
is presented in the next section. 

3 Formulation of the model in bosonic sector 

3.1 General two-boson potentials: conformal coordinates 

Eventually we want to examine the properties of scalar matter generating gravity. Therefore 
let us supply the five- dimensional space with gravity providing it with a pseudo Riemann 
metric tensor qab- This tensor in flat space and for the rectangular coordinate system is 
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reduced to rj^^ . We define the dynamics of two real scalar fields and H{X) with a 

minimal interaction to gravity by the following action functional, 

S[g, <^,H] = j (fX^lC^g, H), (15) 

C = ^-\mIR + \{dA^d^^ + dAHd^H) - y ($, /7)| , (16) 

where R stands for a scalar curvature, \g\ is the determinant of the metric tensor, and M^, 
denotes a five- dimensional gravitational Planck scale. 
The equations of motion are 

Rab - -^QabR = j^Tab, 

where D"^ is a covariant D'Alambertian, and the energy-momentum tensor reads. 

Tab = dA<^dB<^ + dAHdeH - qab (^dc^d""^ + dcHd'^H - V ($, H)^ . (18) 

In order to build a thick 3 + 1-dimensional brane we study such classical vacuum configura- 
tions which do not violate spontaneously 4-dimensional Poincare invariance. In this Section 
the metric is represented in the conformally flat form, qab = {z) tjab- This kind of metric 
suits well for interpretation of scalar fluctuation spectrum and their resonance effects (i.e. 
scattering states). 

For this metric the equations of motion read, 

{§)' = - '^Imsa' ^ -^A'V{^,H) = 3M![A'A" + 2A{Ar), (19) 
(A3$')' = A^|^, {A^H'y = A^^. (20) 

One can prove that only three of these equations are independent. 

Following the arguments of the previous section we assume that the potential is analytic 
in scalar fields, exhibits the discrete symmetry under reflections $ — > — $ and H — > — H 
and has a set of minima for nonvanishing v.e.v. of scalar fields. Correspondingly there 
exist constant background solutions {^mm, -f^mm} which are compatible with the Einstein 
equations provided that (V^($,if)) = V^({$mm, -f^mm}) = ^cosmMl < 0, i.e. for positive 
cosmological constant Xcosm- In this case the warped geometry will be of Anti-de-Sitter type, 
1/A ~ ±kz with AdS curvature k = \/—Xcosm/Q as in the Randall- Sundrum model II [ID] . 
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3.2 Minimal realization in 0* theory: gaussian normal coordinates 

In this Subsection we study the formation of a brane in the theory with a minimal stable 
potential admitting kink solutions. It possesses a quartic scalar self-interaction and wrong- 
sign mass terms for both scalar fields This potential is designed with f/^(l)-symmetry of 
dim-4 vertices but with different quadratic couplings. The conveniently normalized effective 
action has the form, 

S,ff{^,g) = ]^Ml j d''X^\[^-R + 2Kosm + ^(dA^d^^ + dAHd^H 

+ 2M2$2 + 2/\hH^ - + H^f- I , (21) 



where the normalization of the kinetic term of scalar fields k is chosen differently from ([15 
in order to simplify the Eqs. of motion (see below )0. They are connected as follows, 



3kM^ 



1/2 



(22) 



M2 

For relating it to the weak gravity limit we guess that k ~ M'^ /Ml is a small parameter, 
which characterizes the interaction of gravity and matter fields. Let us take > then 
the true minima are achieved at = ±M, Hmin = and a constant shift of the potential 
energy must be set Vq = in order to determine properly the cosmological constant Xcosm- 
Now we change the coordinate frame to the warped metric in gaussian normal coordinates, 

ds^ = exp (-2p (y)) dx^dx^ - dy^, y=[ dz'A{z'). (23) 

Jo 

This choice happens to be more tractable for analytic calculations than the conformal one 
used for (l20l) . With the definition (l23ll the function y{z) is monotonous and z ^ —z =^ 

y -y- 

The Eqs. of motion (120|) for this metric take the form, 

$" = -2M2<| + V<l' + 2l>(l'2 + i/2), (24) 
H" = -2AhH + 4:p'H' + 2H{^^ + H"^), (25) 

p" = ^i^" + H"), (26) 
Xcosm = -Qp" + ^ + (H'f + 2M2<|2 + 2AhH' - ($' + H'f - M'] .(27) 

When compared to Eqs. fl20l) one finds that in the gaussian coordinates the equations 
flM|) . fl25|) . f l26|) are algebraically simpler being linear in the metric factor p{y). It allows to 
calculate few first orders in gravitational perturbation theory analytically. 



^ It could be inherited from the low-energy effective action of composite scalar fields induced by the 
one-loop dynamics of five-dimensional pre-fermions [24] . 
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As expected for constant background solutions $min = ±M, Hmin = the cosmological 



constant Xcosm completely determines the metric factor p' = y —Xcosm/Q- In general, for any 
classical solution, the right-hand side of fl27p is an integration constant that can be proven 
by differentiating this equation. Thus Xcosm is indeed a true constant at the classical level. 

The above equations contain terms which have different orders in small parameter k, and 
accordingly they can be solved by perturbation theory assuming that, 

lp'(y)l_o,,)_IP"MI 



Then in the leading order in k the equations for the fields ^ {y) ,H (y) do not contain the 
metric factor, and the metric is completely governed by matter order by order in k. 

Depending on the relation between quadratic couplings and Ah there are the two 
types of z-inhomogeneous solutions of the equations fl27|) which have the form of a two- 
component kink [25]. For gravity switched off the first one holds for A// < M^/2, 

<!> ^ $0 = ±Mtanh(M?/) + 0(k), H{y) = 0, (28) 

and therefore the conformal factor to the leading order in k, reads, 

pi (y) = Y jln cosh (My) + ^ tanh'iMy) | + O (k^) , (29) 

which is chosen to be an even function of y in order to preserve the remaining r symmetry. 
The second one arises only when < Ah < M^, i.e. 2Ah = + p?, p^ < M^, 



t„fe) = ±Mtauh(/3M,). i/„(,) = ±_j^, /?=^1-^, (30) 

wherefrom one can find the conformal factor to the leading order in k in the following form. 

Pi (^) = f { (3 - In cosh {my) + ^/3'tanh2(/3M|/)| + O [k") , (31) 

as well symmetric against y — )■ — One can see that the asymptotic AdS curvature k 
(defined in the limit y ^ 1/M when p[y) ~ ky) is somewhat different in the r symmetry 
unbroken and broken phases. 



2 2 ( p^ \ p? 

kunbroken = 3^^"^ ^broken = 3^^"^^ 2M'^ ) \ ^ M"^ ^ ^unbroken- (32) 

As the scalar potential is invariant under reflections $(y) — > —^{y) and H{y) — >■ 
—H{y) one flnds replicas of the kink-type solutions which can be uniquely selected out from 
coupling to fermions if to specify their chirality (+M for left-handed ones) and the sign of 
induced masses {+11 for positive masses). Let's choose the positive signs further on. 

Evidently the second solution generates the fermion mass in ( ITOj) whereas the flrst kink 
leaves fermions massless. The solution breaks r symmetry and is of main interest for our 
model building. Thus there are two phases with different scalar backgrounds and it can be 
shown (see below) that if Ah < M^/2 the flrst kink provides a local minimum but for some 
M^/2 < Ah < it gives a saddle point whereas the second kink with H ^ guarantees 
a local stability. 
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3.3 Relationship to conformal coordinate metric 



To the leading order in k one can derive a simple relation between conformal factor A{z) 
and pi{y)- Namely, with a certain ansatz for A{z) the first equation for the metric factor in 
f fT9|) taken in the variables ( 122|) is linearized, 

A{z) = /(O) = 0; f" = n^^^l^^ (l + /) . (33) 

Then the expansion in powers of gravitational coupling constant n is given by / = 'Y^^=i '^"'fn 
and the leading order fi obviously coincides in functional dependence with f l26|) for the r- 
symmetry unbroken phase or fl3T|) for the broken phase, 

k/i(2) = pi(y -> 2) = ^ I (3 - (3^) In cosh {13 Mz) + ^(3^ tanh\l3Mz) | + O (/t^) . (34) 

However the perturbative expansion in k is not valid for any z . Indeed for l3Mz ^ ^ 1 
the asymptotic f{z) is linearly growing and the second term in the right-hand side of Eq. 
(!33|) dominates over the first one which generated the perturbation series. In spite of that 
in conformal reference frame the coordinate asymptotic at Mz ^ 1 is given by the leading 
order in k as f{z) — )• kz the next orders in k, have a more complicated nonanalytic struc- 
ture. Thereby the perturbation theory in gaussian normal coordinates happens to be more 
tractable. 



3.4 Next approximation in k,: unbroken r symmetry 

Let us find the modifications of kink profiles and the shift of critical point under gravity 
influence. In the unbroken phase (zero order in fi) the expansion in k reads, 

CXI cx> 
n=0 n=l 

In order to simplify the asymptotic behavior and analytic structure we introduce also the 
coupling dependence into the argument of iterated functions similar to Eq. fl30l) )./j — )■ /3{k) 
with the expansion. 



(36) 



After rescaling y = t/ {/3M), $ — ?■ M$ the next-to- leading order for $ obeys the equation, 

{dl + 2- 6$^)$i = 4p;$[, - 2k (^1^ ^ $o(l - ^l) ^ Giir), (37) 

where the definitions (!28|) and (!29l) have been used. Its real parity-odd solution can be found 
by integration of (1371) . 

$1 = ^^ [ dr'cosh^' r dr" ^\ ai(r). (38) 
cosh T In cosh r" 
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It decreases at infinity for ^-^j =4/3 and looks as follows, 

^ 2 sinhr ^^^^ 
9 cosh^ r 

Therefrom the appropriately iterated function $(?/) can be represented as, 

^(y) = Mtanhl^My (l- K ^ ] + O(k^); (3 = 1--k. (40) 

The second approximation of conformal factor p'^ derived directly from fl39l) obeys the equa- 
tion, 

P2 = '^^oK (41) 

which can be integrated to, 

p' =-'^tSinh My (3s + ^4 + ^4 V (42) 

135 ^ V cosh^ My cosh^ My J ^ ^ 

Accordingly the iterated result could be assembled in, 

2 8 , 1/26 

P(^) = 3'«(1 - ^'^Jlogcoshr + -K I 1 - — K 

6 V 45 y cosher 15 coshV ^ ' 

1 8 
= — nil k) logfl — tanh^ r) 

K 44 K"'^ 

+-(1 - —K) tanh^ r + — tanh^ r + ^(/s:^), (43) 
o 45 15 

where the first expansion is ordered in accordance to its decreasing at large y and the second 
one characterizes better the vicinity of ?/ = where the normalization p(0) = is employed. 

3.5 Next approximation in k: broken r symmetry phase 

Above the phase transition point one discovers nontrivial solutions for H[t) which satisfy 
the properly normalized Eq. fl25|) . When a weak gravity is present then all functions and 
constants are taken depending on k, 

H{t) = M n-{4^)''^^'H^,^{r)- <l(r) = M ^ 

n,m=0 n,m=0 
00 „ 

— ^ / H \ ^'"^ 

P(^) = 2^ '^'^[m) ^"+1.'"(^)' P'^-O^Pn, 
n,m=0 

Ah = AhA^) + (44) 
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as well as, 



/3 



3i= 2^ '^AmJ \j2 



1 



1; 



n,m=0 



1 



1; 



The position of the critical point yU = is generically shifted, 

1 ^ 1 / 44 \ 

n=0 ^ ^ 



(45) 



(46) 



which can be established from the consistency of integrated EoM. Indeed, in the leading 
approximation against its normalization scale /i the function H[t) satisfies the equation. 



{dl + 1 - 2<^l,)H,,, 



1 



1,0, 



1 



(47) 

Ho^o^Iq + 4i/o,o$o,o$i,o = ^i(r). 



1,0 



Its solution can be found by integration of (148 

1 



-f^i,o 



coshr 



•-^1,0 



dr cosh^ r' 



1 



coshr 



(48) 



and it is given by, 



-f^i,o 



27 cosh r 



(Cfo - 2 log cosh r + 3 tanh^ r) 



(49) 



provided that (146!) holds. The integration constant C^f^Q is not fixed at this order in k, /i. 

Mixed orders in k and /x^/M^ practically irrelevant as in realistic models k ~ 10^^^ 
and /M"^ ~ 10"^ (see [2l] and the Sect. 7). Correspondingly, Kjj'^/M'^ < k < jj.^/M'^. 
Therefore the overlapping of classical solutions ( 15U]) . ( ^T]) with solutions (HUj) ( H5]) . ( H^ 
provides our calculations with required precision in the case when the perturbation expansion 
works well. The latter seems to be flawless for classical EoM. 



4 Field fluctuations around the classical solutions 

4.1 Quadratic action and infinitesimal diffeomorphisms 

We consider small localized deviations of the fields from the average background values and 
find the action-square corresponding to them. 

Action (fT5|) is invariant under diffeomorphisms. Infinitesimal diffeomorphisms corre- 
spond to the Lie derivative along an arbitrary vector field (^{X), defining the coordinate 
transformation X X = X + ( (X) . 
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Let us introduce the fluctuations of tlie metric Hab {X) and tlie scalar fields {X) and 
X {X) on the background solutions of the equations of motion, 



gAB {X) = (z) {r]AB + hAB {X)) ; 

$(X) = <|.(^)+0(X); H{X) = H{z) + x{X). 



(50) 



Since 4D Poincare symmetry is not broken, we select the corresponding 4D part of the 
metric h^y and introduce the notation for gravivectors h^^ = and graviscalars h^^ = S. 
By rescaling the vector fluctuations = A^^^ and the scalar ones Cs = ^Cs; we obtain the 
following gauge transformations in the first order of C^{X) , 



- — 



Vf, 



(51) 



with an accuracy of order O (C^, h?, hQ. Herein "," denotes a partial derivative. 

Now expand the action to quadratic order in fluctuations. The full action after this 
procedure is a sum, 

jC(2) = Ch + jC0,x + + ^v, (52) 

where 



1 

4 



1 

4 



:h'- 



(53) 



<t>,x 



L'2 



+ X„X--(x')^)-^A^(^0^ + 2 



'd^dH' 



+ 



X 



(54) 



\g\Cs = -i^-A'VS' + Si^M!A^h>;;:,-hi';)+M-^{A^yh' 
+2(A3($'0 + H'x))' - 4A=^(<I>'0' + H'x') 



(55) 



+2A^($'0,^ + H'x,^) + Mt [A')S, 



(56) 



where v^y = 
of freedom. 



Vfi^u — Vu,fj., h = h^jjiTj^" . Transformations fl5T]) allow to eliminate gauge degrees 
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4.2 Disentangling the physical degrees of freedom 

A physical sector can be determined after the separation of different spin components of the 
field h^i, in the system. It can be accomplished by description of ten components of 4-dim 
metric in terms of the traceless-transverse tensor, vector and scalar components [T6| 1^ . 



h^,u = V + ^M,!' + ^'^,f^ + ^.Mi' + Vf^i^i', (57) 

where 6^,^ and obey the relation 6^^, = 6 = = F^^. Obviously, the gravitational fields 
bfj^i, are gauge invariant and thereby describe graviton fields in the 4-dim space. Let's expand 
the gauge parameter and vector fields into the transverse and longitudinal parts, 

C^ = C^ + 5^C, 9^C^ = 0; v, = v;^ + d,v, 5^ = 0- (58) 
Then the vector fields are transformed as follows, 

F,^F,-c^, <^<-c^ (59) 

i.e. the expression F'^ — is gauge invariant. In turn, the scalar components r], E,ip, S, (p 
change under gauge transformations in the following way, 

9 4' 9 <J)' F7' 

^^^ + ^C5, S^S-jC, 0->0+_C5, ^^^ + —(^. (60) 

Therefrom we can find four independent gauge invariants, 

1 A 2 A' 1 / A \' 

2^'-^-^^; -^ + 1$^'^' 2^^+(¥^'^j' H'<P-<^'x- (61) 
Using the parametrization ( 157|) we can calculate components of the quadratic action, 

h = h'; = DE + A^; = □(F" + F'") + 1"; Kafi = + ^^p■, 

^r;. - = -SD^i /ijr, - /I,, = DF, - 3 V ' (62) 

Thus, the decomposition (157|) entails a partial separation of degrees of freedom in the la- 
grangian quadratic in fluctuations. 



^--^MlA" + + 2(^')' + ^^fS 



-^AV(<|., H)S' + 4^'($> + H'x) + - iJV + A'{^cP + l^x)) } 

+^MM' □(i^' - 2v) {^S + f + ^(<^>'0 + H'x)) , (63) 
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where f^ = F'^-vj^, f^^ = - A/. • 

We see that some redundant degrees of freedom exist , one of vectors F'^,v^ and one 
of scalars E', 77. They can be removed to provide = 0. Obviously, in the quadratic 
approximation graviton, gravivector and graviscalar are decoupled from each other. From 
the last line it follows that the scalar E' is a Lagrange multiplier and generates a gauge- 
invariant constraint, 

^'5 + ^' = -^(*> + ^'x)- (64) 
Thus taking this constraint into account only two independent scalar fields remain. 



5 Scalar field action in gauge invariant variables 

The further analysis of the scalar spectrum is convenient to perform in gauge invariant 
variables. Let us perform the following rotation in (0, x) sector: 

(f) — ^cos9 + xsinO, X = — 0sin6' + xcos6' 

cose = |, sin^ = |^, = ($')' + (//')' (65) 

While X is gauge invariant (p is not. We can exclude redundant gauge invariance intro- 
ducing three gauge invariant variables: 

OA' 2 2A /TZ \ ' 2 

^ = ^-_^, S = S + ^ = E'-2,--0. (66) 

Accordingly the scalar part of the lagrangian quadratic in fluctuations takes the form: 

-\a''V{^,H)S^ + \mIA' U^i^^S + i^')). (67) 

where 9' = (arctan f^)' = {H"^' - ^"H')/n^ 

Prom the last hue it follows that the scalar field 77 is a gauge invariant Lagrange multipher 
and generates a gauge invariant constraint, 

^S + i,' = 0. (68) 

Thus after taking this constraint into account only two independent scalar fields remain and 
the scalar action takes the following form, 

+f {a.xa,x - m? - (iff? + ^ (5*.) ' a^y (5*,)) A m 
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To normalize kinetic terms the fields should be redefined x = ^^''^X? ^ = where = 

^\ [^xd^^ - (d^^f - ^ - ((^')^ + 1 (S)'^^^ (S)) (^0) 

6 Fluctuations in different phases and at critical point 

6.1 Fluctuations around a r symmetric background 

When H{z) = the two scalar sectors decouple because ^ = 0. The operator which describes 
the branon mass spectrum, 

< = -9l + ^= d^ + TT) -d. + TT)^ (71) 



is positive on functions ipi^) normalizable along the fifth dimension z. Indeed, the possible 

zero mode is singular 4'{z) ~ i7 ~ I/2; .It corresponds to the centrifugal barrier in the 

potential at the origin |22j. Thus in the presence of gravity there is no a (normalizable) 

Goldstone zero-mode related to spontaneous breaking of translational symmetry. The cause 
is evident: the corresponding brane fiuctuation represents, in fact, a gauge transformation 
(ISTj) and does not appear in the invariant part of the spectrum. One could say that in 
the presence of gravity induced by a brane the latter becomes more rigid as only massive 
fiuctuations are possible around it. Of course, the very gauge transformation ( |5T1) leaves 
invariant only the quadratic action and thereby a track of Goldstone mode may have infiuence 
on higher order vertices of interaction between gravity and scalar fields. This option is beyond 
the scope of the present investigation. 

As to the possible localized states with positive > they may exist with masses of 
order M. However for the action fl?Il) they happen to be unstable resonances as it will be 
evident from the spectral problem formulated in gaussian normal coordinates. 

The fiuctuations of the second, mass generating field H{x) do not develop any centrifugal 
barrier and as < H >= their mass spectrum is described by the operator. 



^-dl + V{z). (72) 



"X ■ ^3/2 ^gjjy 

Its potential is not singular and for background solutions delivering a minimum this operator 
must be positive. For the minimal potential with quartic self-interaction ( l2Ti) (in terms of the 
rescaled variables ( 122|) ) one can come to more quantitative conclusions. Indeed, for gravity 
switched off the background ^{z) = $o(-2) (pay attention to y z\) is defined by (128|) . 
Accordingly the mass spectrum operator receives the potential 

V{z) = -2Ah + 2$^ = (Af2 - 2 Ah) + (l - —^j^) ■ (73) 
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The only localized state of the mass operator is x ~^ Xo — 1/ cosh(Mz) with the 
corresponding mass ttiq = — 2Ah as expected. Thus in the unbroken phase with > 
2Ah the lightest scalar fluctuation in x channel possesses a positive mass and the system 
is stable. In the critical point, = 2Ah, a lightest fluctuation is massless and for < 
2Ah < 2M^ the localized state Xo represents a tachyon and brings instability providing a 
saddle point. Instead the solution ( !30l) provides a true minimum (see |25]). 

Qualitatively the spectrum pattern in the gravity background remains similar. But the 
derivation of localized eigenf unctions uniformly in coordinate z encounters certain difficul- 
ties as explained in the Subsection 13.31 and therefore it will be done in gaussian normal 
coordinates. 



6.2 Fluctuations in gaussian normal coordinates 

To simplify analytical calculations let us represent the quadratic action for scalar fields in 
the gaussian normal coordinates x^,?/, 

ds'^ = {z) [dx^dx^ - dz^) = exp (-2p (y)) dx^dx^ - dy'^. (74) 

We remind the formulas for the transition, 

exp p (y) dy, A (z) = exp (-p (y)) . 

Below the prime denotes differentiation with respect to y. Further on we focus on the 
minimal potential with quartic self- interaction fl2T|) in terms of the rescaled variables (122|) ). 
To simplify the form of the action let us introduce TZ = exp(p)7^ and in addition redefine 
the fields in order to normalize kinetic term, ip = exp{—p/2)ilj,x = exp(— p/2)x. 



(2), seal 



d'^xdy 



^d^^d>'^ + ^d.xd^x - 2exp(-2p)^^'x I 5, + p' + ^ - ^ U- (75) 



7^' 



n 



"2 exp(-2p)^ 



p' n 



TZ' 



dy + ^--^\+ 2p'dy + 3(p')' + 3p" - 4p'^ ) - 



n 



n 



i -p(-2p)x I -di + (or + i (S) ' (S) + ^''^y + '^P' 



where the second variation of the field potential reads 



A^H -2Ah + 2$2 + 6i^2 

Let us perform the mass spectrum expansion, 

^(X) = exp(p) ^vl/M(a;)^^(y), x{X) = exp(p) vl/M(x)x™(y), 



(76) 



(77) 
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where the factor exp(p) is introduced to ehminate first derivatives in the equations. We 
obtain the following equations, 



p' n J \ p' n J 

26' ldy-^ + '^-2p' + ^]xm = exp(2p)m2^^, (78) 



P' n " 



+26' + ^ - ^ + 2p' j = exp{2p)m\^. (79) 

This is a coupled channel equation of second order in derivative and with the spectral pa- 
rameter as being a coupling constant of a part of potential (a non-derivative piece). The 
latter part is essentially negative for all > 0. Then as the exponent p{y) is positive and 
growing at very large y it becomes evident that the mass term in the potential makes it un- 
bounded below. Thus any eigenfunction of the spectral problem ( !79l) is at best a resonance 
state though it could be quasilocalized in a finite volume around a local minimum of the 
potential. In ^24j the probability for quantum tunneling of quasilocalized light resonances 
with masses m <^ M was estimated as ~ exp{ — ^In^} which for phenomenologically ac- 
ceptable values of K ~ 10~^^ and M/m > 30 means an enormous suppression. Moreover 
in the perturbation theory the decay does not occur as the turning point to an unbounded 
potential energy is situated at y ~ 1/k. Therefore one can calculate the localization of 
resonances following the perturbation schemes. 
In the limit k — )• we obtain, 





P'i 



n' 


6"\ 


n 




p'i 


n'\ 


p'l 





m'iJm, (80) 



< + + ^ d'V ~ , J jxm + 26'\^dy + ^-^]^^ = (81) 

where pi is first order of n. 

6.3 Phase transition point in the presence of gravity 

In the unbroken phase H{y) = and the equation on x takes the form, 

+ ^e-^ (-2A, + 2$^) + 4(pr - 2p"] x^ = ^e^^X., (82) 



where the variable r = (5 My is employed and the derivative is defined against it. 
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Let us perform the perturbative expansion in k, 



n=0 



(83) 



n=l 



n=l 



and use also the expansions (l35l) and ( 136|) . The hmit of turned off gravity is smooth and the 
differential operator on the left-hand side of ( l82i) can be factorized, 



M2 - 2Ah 
M2 



+ (—dr + tanhr)(9,- + tanhr) 



Xm,0 



M2 



(84) 



which corresponds to A^^ = 1 for zero scalar mass (phase transition point). In general, for 
— 2Aiy > one finds one localized state with positive m^, 



X 



cosh' 



+ 0{k), = -2Ah + 0(k 



(85) 



as it was already established in the previous Subsection. 

Let us now examine the phase transition point where = and calculate the next 
approximation of k: 







+ 1 



Xi + 



+ 



cosh 



cosh 

- Ai, + 4$o$i-2p;' 



Xo- 



(86) 



||k + 0(k^)) exactly as it has been obtained in (jl6 



At critical point Ah = Ah^c 
Accordingly there exists a normalizable solution of f l86p which is a zero-mode corresponding 
to the second-order phase transition. In this case the corresponding first correction of x 
takes the form, 



1 1 



Xl = 77- 



1 40, ,^ , , 38 ^ 
— - — ln(2 cosh r) + — + Ci 
cosh TO 3 . 



7) 



9 cosh r 

where for the constant Ci = this correction is orthogonal to Xo- Thus in the scalar sector 
not mixed with branon (gravity) fluctuations the localization of massless state occurs in the 
presence of gravity. It can also be shown that for Ah < Ah,c the quasilocalization of light 
states in this sector takes place. 

When Ah > Ah,c the squared mass becomes negative signalling the instability of the 
unbroken phase. In broken phase mixing terms are nonzero and one has to study spectrum 
by perturbation theory near critical point. The calculations are not presented in this paper 
because of their high complexity but to the leading order in k they provide the same mass 
for light scalar state as in the model |25] without gravity, namely, = 2/1^ + 0{ix^ / M"^). 
This state is associated with the fermion mass generation (Sect. 2) and substitutes the Higgs 
field of the Standard Model. 
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7 Conclusions: consistency of scales and of gravita- 
tional coupling with modern data 

To consider phenomenological implications we have to study interaction of the scalar matter 
with fermions, 

Cf = ^{i^-gKn^-gHTiH)^, (88) 

where in general we can introduce different Yukawa constants for different fermions of the 
Standard Model (SM). The localization profile depends on the first coupling 



Correspondingly in the leading order in ^ and k the fermion mass is described by 



(89) 



As it was shown in Sections 3, 6 the scalar fluctuations have a single normalizable state 
associated with the fermion mass generation, 

* = *„W+0(A), H^H.(y) + Uvn.no{^), X., = ^^^, (91) 

with the mass, nih = V2fi(^l+0(^-^^y For^<Mlow energy four- dimensional Lagrangian 
including only the lightest states takes the following form, 

Ao«, = J Xoiyfdy ■ [d.hd'-h - mlh') + 2 J Mvfdy ■ ^(^^ - m^j^ - 

r+oo 

-2gH / MyyXo{y)dy^h^. (92) 



After normalization. 



we obtain the following Yukawa coupling constant between Higgs-like boson and fermion. 



^/3.UJ '''^J--M^dtaMyrdy n.yMjm,- 
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We can compare it with similar couplings X,gt,sM in the standard Higgs model. We adopt 
the normalization of coupling constants in the Higgs potential of the Standard Model as 
follows, 

11 771 

VsM{hix)) ^ -m'h' + Xh\ (h) = ^ = -=. (95) 

V 2 V 2A 



The scale v ~ 2AQGeV stands for the v.e.v of the Higgs field h in the Standard Model |42] . 
For the top quark channel dominating for the Higgs boson decay via one-loop mechanism 
one obtains, 

ruh = V2Xv, TTit = —j=gt,sM ■ V gt,sM = 2y/X—. (96) 
Accordingly the relation between the Yukawa coupling constants is given by, 

A^^^f^y. (97) 



9isM 6k VM, 

Let us involve the gravity scales coming from reduction of five- dimensional Einstein- Hilbert 
action to the four- dimensional one [24], 

= kMl, (98) 

which can be derived from the graviton kinetic action ( l63ll when taking the wave function 
h'^j^ = for massless graviton. It determines the four- dimensional gravity scale, the Planck 
mass, Mp ~ 2.5 ■ lO^^GeV [32]. 

From the experimental bounds on the AdS curvature in extra dimension [13] one can 
estimate the minimal value for the mass scales, M^,, M as well as for the dimensional gravi- 
tational coupling n. Indeed, if combining f l98|) . fl32|) and f l97|) one gets, 

V 9t,SM 2^/XMp gt ^ ' 

The modern bound for the AdS curvature, k > 0.004ey. As well the excess of 77 pair 
production observed recently on LHC [44j could be explained by the Higgs particle decay 
/i — )■ 77 via virtual it triangle loop if the Yukawa coupling is abnormally larger than the 
SM value, ^' = 1 -^ 1.5. All together it entails the following bounds for the scales and 

' 9t,SM ^ ^ 

couplings of our model, 

M > 3.5TeV; > 3 ■ lO^GeV; k>2- 10~^\ (100) 

Thus we conclude that the gravitational corrections on localization mechanism are indeed 
very small except for branon spectrum. But the thickness of the brane may affect the 
high energy scattering processes already at the next LHC running and show up in appear- 
ance/disappearance processes, in particular in missing energy events [12] 
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